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Abstract 

It is shown that large deviation statistical quantities of the discrete time, finite state Markov 
process P^+i = YLk=l HjkPn i where P„ is the probability for the j-state at the time step 
n and Hjk is the transition probability, completely coincides with those from the Kalman map 
corresponding to the above Markov process. Furthermore, it is demonstrated that by using simple 
examples, time correlation functions in finite state Markov processes can be well described in terms 
of unstable periodic orbits embedded in the equivalent Kalman maps. 
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I. INTRODUCTION 



Over the last three decades, nonlinear dynamics and chaos have played significant roles 
not only in natural science and mathematics but also in engineering and social science 

ELQ 

. Chaotic dynamics has many different kinds of aspects. This is one of the reasons 
why many researchers in various fields have studied extensively for so long time. 

The most important characteristic of chaos is the "trajectory instability", which makes 
the long-term predictability impossible . This characteristic can be quantified with 

positive Lyapunov exponent. Owing to the long-term unpredictability, chaotic dynamics 
can be used as random number generators. On the other hand, one cannot predict the 
state of a physical variable in future obeying a stochastic process. However, the origin of 
the unpredictability in stochastic process is believed to be different from that for chaotic 
dynamics. In connection with this fact, one may ask "Is it possible to precisely simulate 
stochastic process with a chaotic dynamics suitably constructed?". In other words, does a 
hidden dynamics which gives the same statistics as the stochastic process under consideration 
exist? The present paper concerns with this question. 

The possibility of the construction of the one- dimensional chaotic map which is equivalent 
to a finite-state Markov process 

^?i = X>-^ (i) 

fc=l 

(n = 0, 1, 2, 3, • • • ) was proposed by Kalman [j| in 1956. Here, Pn^ is the probability that 
the state is in the j-th state at time step n, (X/jLi-fn = 1)- The Hjk is the transition 
probability from the fc-th state to the j-th state in a time step and satisfies ~52j=i Hjk = !• 
Kalman showed how to construct one-dimensional chaotic map 

Xn+l = f(x n ) (2) 

corresponding to the process (1), where the mapping function f(x) is completely determined 
by the transition matrix H = {Hjk}. The mapping dynamics (2) constructed by Eq. (1) is 
called the Kalman map and its simplified review is given in Appendix A. The Kalman map 
is a sort of piecewise linear Markov transformations which map each interval of the partition 
onto a union of intervals of the partition. Markov transformations have been studied by 
many researchers j^l, 1(3] and play an important role in the study of chaotic dynamics. 



In fact, Kalman map gives the invariant probability same as the the corresponding Markov 



map (1). Recently, Kohda and Fujisaki ll| showed that the double-time correlation function 
obtained from (2) precisely agrees with that obtained from the corresponding Kalman map. 

In the sense that the stochastic process is generated by the deterministic chaotic dynamics, 
the latter may be called the hidden dynamics of stochastic process. This fact leads to a 
quite interesting problem. It is well known that statistical quantities including dynamical 
correlation functions in chaotic dynamics can be well approximated in terms of unstable 
periodic orbits embedded in the corresponding strange attractor. Therefore, if a stochastic 
process can be determined by a corresponding chaotic dynamics, it is naturally expected 
that statistical quantities in a stochastic process can be determined by the corresponding 
chaotic dynamics, particularly in terms of unstable periodic orbits embedded in the latter 
dynamics and, therefore, in the stochastic dynamics. The main aim of the present paper 
is to show the possibility of the determination of the statistics of the stochastic process 
(1) in terms of unstable periodic orbits of the corresponding Kalman map. Namely, the 
present paper concerns with the hidden dynamics of a finite-state, discrete-time stochastic 
process and, in particular, the relation between statistical properties of stochastic process 
and unstable periodic orbits being subtended in the hidden dynamics. The main results of 
the present paper are as follows: 

(i) The large deviation statistical quantities calculated in the stochastic process (1) rigor- 
ously coincide with those derived from the corresponding Kalman map. Furthermore, 

(ii) by using several simple stochastic processes, we show that double-time correlation 
functions of stochastic processes can be well approximated with those obtained in 
terms of unstable periodic orbits embedded in the corresponding Kalman map. 

The present paper is organized as follows. In Sec. II, we briefly summarize statistical 
quantities of the process (1) and the construction of the corresponding Kalman map. It is 
shown that the statistical quantities, i.e., the invariant density, the double-time correlation 
function and the large deviation statistical quantity for the stochastic process rigorously 
coincide with those obtained from the Kalman map. In Sec. Ill, making use of simple 
models, we will show that the double-time correlation function of the stochastic process can 
be well approximated by those determined in terms of unstable periodic orbits embedded in 
the Kalman map. Concluding remarks and discussions are given in Sec. IV. In Appendix A, 



explicit mapping functions are given for two- and three-states stochastic processes. Appendix 
B is devoted to the proof of the statements in Sec. II. In Appendix C, we will briefly review 
the Markov method which enables the double-time correlation function to be expanded in 
terms of same-time correlation functions. Furthermore, in Appendix D, we give a comparison 
of the double-time correlation function determined with a single unstable periodic orbit. 

II. EQUIVALENCE OF STATISTICAL DYNAMICS GENERATED BY 
STOCHASTIC PROCESS AND THE KALMAN MAP 

In the matrix form, the Markov process (1) is written as 

P n +i = HP n , (3) 

where P n = (Pn\ Pn\ ■ ■ ■ , Pn N ^) T is the probability matrix and H is the transition matrix 
with the jk element H^. The steady probability distribution is determined by 

P* = HP*, (4) 

where P* = (Pi^jP* 2 ^, ■ ■ ■ ,P* N ^) T . This implies that P* is the eigenvector of H with the 
eigenvalue 1. 

Let us consider the dynamical variable u n at the time step n, and let u n take the value 
if the state is in the j-th state. The double-time correlation function for the fluctuation 
5u n = u n — (u), (u)(= Ylf=i a^P*^) being the average value, is given by 

C n = (Su n 5u ) 

N N 
j=l k=l 

with Sa^ = - (u). 

Furthermore, for the sake of later discussion, we here briefly summarize the large deviation 
theoretical study of the stochastic process. Consider a steady time series {uj}. The finite- 
time average 

j n— 1 



4 



n being the time span of averaging, is a fluctuating variable. For n — > oo, the average 
approaches the ensemble average (u). However, for a large but finite n, u n shows a fluctu- 
ation. Let Q n {u) be the probability density that u n takes the value u. As is known, for a 
large n, Q n (u) asymptotically takes the form Q n (u) ~ e -s(u)n where S'(tt) called the 
rate function or the fluctuation spectrum 3] is a concave function of u and has a minimum 
5 = at u = (u). The fluctuation spectrum characterizes the fluctuation statistics of the 
time series {u^}. The large deviation theoretical characteristic function Z q (n) for the time 
series {u^} is defined by 



Z g (n) = (exp(qnu n )) 



n-l 

oxp | q Uk 

k=0 



(7) 



where q is an arbitrary real number and (■ ■ • ) is the ensemble average. For a large n, Z q (ri) 
asymptotically takes the form Z q (n) ~ e^ n , where <fi{q) depends only on the parameter q 
and characterizes the statistics of {uk}- The fluctuation spectrum S(u) is derived by the 
Legendre transform of 4>{q) as <fi(q) = — mm u [S(u) — qu] [13|, 



14 



16 



17|,ll8|,ll9|. 



If we introduce the generalized transition matrix H q with its jk element defined via [1 



(H q ) =H jk exp[qa {k) ]. 

V / jk 



jk 

The large deviation theoretical characteristic function is written as 



(8) 



N 



Z q (n) 



(9) 



fc=i 



Therefore, one finds that the characteristic function (p(q) is determined by the largest eigen- 
value of the generalized transition matrix H q [is| . 

It is known that the same steady probability distribution as that in Eq. (4) can be 
produced by a one- dimensional map, called the Kalman map, suitably constructed. In the 
remaining part of this section, we first explain how to construct the Kalman map. The 



following discussion is the simplified one proposed by Kalman 



7] 



First, we define the positions (3j (J = 1, 2, • • ■ , iV 2 ) with @ = and (3^2 = 1 in such a 
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way that they satisfy 



P. 



N 



P(j-1)N+1 - P(j-1)N 

02N ~ Pn 

P(j-l)N+2 — P(j-1)N+1 

PzN — @2N 
P{j-l)N+3 - (3(j-l)N+2 



H 2j \ 



PkN — P(k-1)N 
P(j-l)N+k — P(j-l)N+k-l 

Pn-N — P(N-1)N 
P(j-1)N+N — P(j-1)N+N-1 

(j — 1, 2, • • • , N). These equations are solved to yield 



rr— 1 
Nj" 1 



(10) 



1 k 

1=1 



(11) 



(k — 0, 1, 2, • • • ,N). We thus find that /3(j_i)Ar+jt — P(j-i)N+k-i — Hkj/N. With these f3j, we 
construct the piecewise linear one-dimensional map f(x) in the range /3(j_i)jv < x < (3jN, 



(J = l,2, 



N) as follows: 
r 

Pn + H^(x - /5(j_i)jv + i) 

(3 2 N + H^(x — f3(j-l)N+2) 



(P(j-1)N <X < (3(j-l)N+l), 
(P(j-1)N+1 < X < P(j_^ N+2 ), 
(P(j-l)N+2 < X < Pq_^ n+3 ), 



P(k-i)N + H k ^(x — /5(j_i)jv+fc-i) (/%-i)AT+fc-i < a; < P^^ N+k ), 



P(N-1)N + H N j(x — /5(j_i)Ar + Ar_i) (/3(j_i)jv+AT-l < £ < /3(j_i)jv+iv) • 



(12) 



Therefore, one finds |/'(x)| _1 = if^j for /3(j_i)jv+fc-i < a; < P^--^N +k . Examples for iV = 2 
and 3 are shown in Appendix A. One should note that the dynamics x n+ i = f(x n ) with the 
mapping function (12) shows a chaotic behavior since the local expansion rate ln|/'(x)| of 
the mapping function is everywhere positive. Therefore, the mapping system (12) turns out 
to be hyperbolic. 
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Let u(x n ) be a dynamical variable taking the value u(x) = att> if x satisfies flu^^ < 



x < PjN, (j — 1) 2, - • • , N). The time correlation function C* of u(x n ) is given by 



where (• • ■ ) is the ensemble average. Here, x n = f n (x) and Su(x n ) = u(x n ) — (u). The large 
deviation statistical characteristic function is defined by 



As is shown in Appendix B, one finds that C n = and Z q (n) = Z^(n). 

It should be noted that dynamical statistical quantities are determined in terms of un- 
stable periodic orbits embedded in chaotic dynamics j^ . This facts implies that since the 
Markov stochastic process (1) is described by the corresponding Kalman chaotic dynam- 
ics, dynamical statistical quantities such as time correlation functions and large deviation 
theoretical statistical characteristic functions of the Markov stochastic process (1) can be 
determined by unstable periodic orbits embedded in the "stochastic process" . In the follow- 
ing section, we discuss the determination of dynamical quantities of the stochastic process 
in terms of periodic orbits embedded in the Kalman map. 

III. PERIODIC-ORBIT DETERMINATION OF TIME CORRELATION FUNC- 
TIONS IN SIMPLE STOCHASTIC PROCESSES 

In this section, we will show that the time correlation functions C n 's for stochastic pro- 
cesses with N = 2 and 3 are well determined by unstable periodic orbits embedded in the 
chaotic dynamics corresponding to the stochastic processes. From Eq. (5), the time correla- 
tion function for the stochastic process can be rigorously obtained as follows. Let /i a and e a 
be respectively the a-th eigenvalue and the eigenvector of H, i.e., He a = fi a e a . One would 
note that there is one eigenstate with the eigenvalue fi a — l. Without losing generality, we 
put /ii = 1. With the expansion 5a^P* = Y^a^aGa 1 ', ea) being the j-th component of e a , 
with the expansion coefficient b a , we obtain 




(13) 




(14) 




(15) 



with g a = b a Ylf=i Sa^ea , where Yl' a implies the summation except the eigenvalue {i\ = 1. 
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As shown in Appendix C, the time correlation function can be approximately obtained 
as follows. First, introduce the vector variable 



u n = (h 1 (x n ),h 2 {x n ), • • ■ , h M+1 (x n )) T = u{x n }, 



(16) 



where u n = h\(x n ) = X/*=i a ^Ij( x n) with the step function Ij{x) defined as 



1 for /3j-i < x < (3j, 
otherwise. 



(17) 



And hj(x) = hi(f J ~ (x)), (j = 1, 2, ■ • • , M + 1). The time correlation function C n is given 
by the 1-1 element (Cn)i,i of the correlation matrix C n = (u n u^) — (uq)(uq). If M is 
suitably chosen, the matrix C n is approximately determined by C n ~ ( n Co, where by noting 

Thus the time correlation function C n is determined by Co and C\. 



-i 



18 



C = CxQ 

This method is referred to as the Markov method (Appendix C). It should be noted that for 
a piecewise constant function G{x) = YljLi Gjlj(x), its long time average is replaced by the 
ensemble average: 

1 n N 

(G(x)> = lim - G{P~\x)) = G k Pi k) (18) 

j=l k=l 

From definition, the functions u{x} and u{f(x)} which are relevant to the calculation of 
C and C\ are piecewise constant in the x space. Therefore C and C\ are obtained as the 
ensemble averages as in Eq. ffTSl . 



On the other hand, we can determine the quantities Co and C\ in terms of infinite 
many unstable periodic orbits that can describe the invariant density p(x 



22 



24 



29 



30]. 



y 



In particu 
follows 31] 



ar, the invariant density of one- dimensional chaotic systems can be obtained as 



p(x) 



N(n) 

lim \^ u>j5(x — p^) 



(19) 



3=1 



with 



Cn 



where pj 1 is a fixed point satisfying f n (pj l> ) = pj 1 ' , and N(n) is the total number of the 
fixed points of f n and C n is the normalization constant. Thus the dynamical correlation 
functions can be approximately expanded in terms of unstable periodic orbits. 



\u n y(vt ] )\ 

In) 



(J 



1,2, 



(») 



N(n)), 
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Hereafter we will compare the exact time correlation functions with those approximately 
determined by periodic orbits for N = 2 and 3. The transition matrices if's for N = 2 and 
3 under study are respectively 



We use the values = and = 1 for the N = 2 case, = 0, = | and a® = 1 for 
the N = 3 case. The results are shown in Fig. [Hand Tab. [I] for N = 2 and Fig. [2] and Tab. [Ill 
for N = 3. Figure [I] (a) and Fig. [2] (a) show the strange attractors of the one-dimensional 
maps corresponding to the transition matrices in Eq. f[20|) . Figure [1] (b) and Fig. [2] (b) 
are the comparison of the exact invariant densities (thick lines) with the approximate ones 
(thin lines) in terms of unstable 15-periodic orbits by use of formula Eq. ( fl9l) . Figured] 
(c) and Fig. [2] (c) are the chaotic time series (Left) and the switching between the states 
(Right) which is generated according to the chaotic time series. The comparison between 
the time correlation function obtained with the Markov method (M = and 1 respectively 
for N = 2 and 3) and the unstable periodic orbits with the exact result from Eq. (TT5|) is 
given in Tables U and [III One finds that the Markov method with unstable periodic orbits 
works quite well. The above results imply that the statistical quantities in the stochastic 
process can be determined in terms of unstable periodic orbits embedded in the Kalman map. 

IV. CONCLUDING REMARKS AND DISCUSSIONS 

In the present paper, we showed that the large deviation deviation statistical quantities 
of a discrete time, finite state Markov process precisely coincides with that obtained by the 
Kalman map corresponding to the Markov process. The chaotic dynamics is self-generated 
and has an inner dynamics. In this sense, although the Kalman dynamics generates the 
stochastic process under consideration, two dynamics are different. Nevertheless, if one 
observes the dynamics of the coarse-grained variable, namely the variable u(x) being inde- 
pendent of x if /3y_i)jv < x < PjN for each label j, provided one cannot distinguish the 
dynamics of the chaotic dynamics and the stochastic dynamics, then two dynamics give 




(20) 
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(a) (b) 




0.2 0.4 0.6 0.8 1 0.2 0.4 0.6 0.8 1 




o 1 1 1 ^ 1 1 1 1 1 1 1 1 

20 40 60 80 100 20 40 60 80 100 



n n 

FIG. 1: Comparison of the results by the Markov process and the Kalman map for N = 2. (a) 
Kalman map corresponding to the Markov process with the transition matrix given in Eq. (|20p , 
(b) Comparison of the exact invariant density (thick line) with the approximate invariant density 
(thin line) in terms of unstable 15-periodic orbits by making use of the formula (|19|) . (c) Chaotic 
time series generated by the mapping dynamics (Left) in (a) and the state evolution (Right) 
corresponding to the figure (a). The stochastic evolution is generated by the equivalent Kalman 
dynamics. 

rigorously same results on statistical quantities, i.e., the invariant probability, double-time 
correlation functions and the large deviation statistical quantities. 

Differences between the stochastic process and the Kalman dynamics are caused by the 
fact that the chaotic variable x n is continuous in contrast to that the states of the present 
stochastic process are discrete. Furthermore, the Lyapunov exponent is determined for the 
chaotic dynamics, while it cannot be determined for the stochastic process. The Lyapunov 
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n 


exact 


approximate 





0.2425 


0.2335 


1 


-0.1027 


-0.0984 


2 


0.0421 


0.0434 


3 


-0.0193 


-0.0173 


4 


0.0097 


0.0078 


5 


-0.0044 


-0.0041 


6 


0.0025 


0.0019 


7 


0.0003 


-0.0004 


8 


0.0000 


0.0000 



TABLE I: Comparison of the exact time correlation function C n from the formula (|15p with the 
approximate one by the Markov method with M = for N = 2. The long time average for 
the latter was replaced by the ensemble average with unstable periodic orbits. See Eq. ([19p and 

Fig. mb). 



exponent A = (In \f'(x)\) = / P( x ) m \f'i x )\dx for the Kalman map is easily calculated as 

(21) 



A 



N N 



k=l 



Although the Lyapunov exponent is the key concept of chaotic system and cannot be denned 
in a stochastic process in a conventional sense, the Lyapunov exponent of the Kalman 
dynamics is fully determined by the quantities contained in the stochastic process. In this 
sense, the quantity f[2"Tj) can be called the Lyapunov exponent of the stochastic process 
(1). One can conclude that the origins of the unpredictability in the finite-state Markov 
stochastic process and the Kalman dynamics, more exactly speaking, the chaotic dynamics 
are same. It is worth while to note that Eq. (j2ip is identical to the equality between the 
Lyapunov exponent and the Kolmogorov-Sinai entropy of one-dimensional map {4, 32 



Since a Markov stochastic process can be generated by the Kalman map, statistical 
quantities of the stochastic process are determined by the chaotic dynamics. By making use 
of simple examples, we showed that dynamical quantities of the stochastic process can be 
well approximated in terms of unstable periodic orbits of the Kalman dynamics in Sec. III. 
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(c) 



0.8 
0.6 



^ 0.4 



(b) 



1.5 



it 



0.5 



0.2 0.4 0.6 0.8 



0.2 



0.4 0.6 
X 



0.8 




FIG. 2: Comparison of the results by the Markov process and the Kalman map for N = 3. (a) 
Kalman map corresponding to the Markov process with the transition matrix given in Eq. (|20p , 
(b) Comparison of the exact invariant density (thick line) with the approximate invariant density 
(thin line) in terms of unstable 15-periodic orbits by making use of the formula (|19|) . (c) Chaotic 
time series generated by the mapping dynamics (Left) in (a) and the state evolution (Right) 
corresponding to the figure (a). The stochastic evolution is generated by the equivalent Kalman 
dynamics. 



Recently, statistical quantities of the turbulence can be approximated with an admissible 
unstable periodic orbit 34J. Furthermore the time correlation function of chaotic dynam- 
ics can be well approximated with an appropriate unstable periodic orbit embedded in the 



attractor 



281 ]. In the case of Kalman dynamics, we showed in Appendix D that the approx- 



imation of time correlations with an appropriate unstable periodic orbit is well done. It is 
found that the admissible unstable periodic orbit have a passing rate which is similar to the 
invariant density of the Kalman map. 

In closing the paper, let us discuss the applicability of Kalman dynamics to more general 
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n 


exact 


approximate 





0.1538 


0.1538 


1 


-0.0327 


-0.0321 


2 


0.0085 


0.0093 


3 


-0.0028 


-0.0021 


4 


0.0007 


-0.0004 


5 


-0.008 


-0.0003 


6 


0.0006 


0.0001 


7 


0.0000 


0.0000 


8 


0.0000 


0.0000 



TABLE II: Comparison of the exact time correlation function C n from the formula (|15p with 
approximate one by the Markov method with M = 1 for N = 3. The long time average for 
the latter was replaced by the ensemble average with unstable periodic orbits. See Eq. ([19p and 

Fig. mjo). 

stochastic processes. As discussed in the present paper, the Kalman map precisely explains 
the statistics of finite state discrete time Markov process. However, the Kalman map is a 
quite special type of mapping dynamics even the dynamics is restricted in mapping system 
in the sense that the Kalman map is piecewise linear and everywhere hyperbolic. In physical 
systems observed in experiments, mapping dynamics are usually neither piecewise nor every- 
where hyperbolic. This fact implies that physically observed stochastic processes generically 
cannot be described by finite-state Markov stochastic process. It is quite interesting and 
important to study the possibility to construct a chaotic dynamics which describe more 
complicated stochastic dynamics such as continuous state and continuous time stochastic 
process. 
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APPENDIX A: KALMAN MAPS FOR TWO AND THREE STATE PROCESSES 

In this appendix, examples of the Kalaman map are shown for N = 2 and 3. One should 
note that the dynamics x n+ i = f(x n ) with the mapping function (12) shows a chaotic 
behavior since the local expansion rate ln|/'(x)| of the mapping function is everywhere 
positive. Therefore, the mapping system (12) turns out to be hyperbolic. 

Let us first consider the two-state stochastic process. The positions (3j (j = 1,2,3) are 
obtained as 



The mapping function of the Kalman map corresponding to the above is given by 



(Al) 



/(*) = { 



H^x (0 < x < Pi), 

(3 2 + H 21 \x-(3i) ((3i<x<(3 2 ), 

Hr 2 1 (x-f3 2 ) {(3 2 <x< f3 3 ), 

fc + H^ix-fo) (fo<x<l). 



(A2) 



V 



The above function is drawn in Fig. 3. 

For the three-state stochastic process, the positions f3j (j = 1,2, 



• , 8) are obtained as 



Pi 



07 



P2 = l(H n + H 21 ), fo= 1 -, 
^(1 + Hi 2 ), p 5 = ^l + H 12 + H 22 ), ft 
^(2 + Hi 3 ), (3 8 = ^(2 + H 13 + H 23 ). 



2 

3' 



(A3) 
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Al ft ft 



FIG. 3: Kalman map constructed from the two-state stochastic process. The positions /3j's are 
given in Eq. (Al). 

The mapping function of the constructed one- dimensional map is given by 









(0 < x < A), 


A + H£ 


[x — 


A) 


(A < a: < A) 


A + h£ 


[x — 


A) 


(ft < x < A) 


H u \x- 


3 S ) 




(A < x < A) 


A + #22 


[x — 


ft) 


(A < x < A) 


A + #32 


[x — 


A) 


(A < x < A) 




A) 




(A < x < A) 


i% + h£ 


[x — 


ft) 


(ft < x < A) 


A> + H^ 1 


[x — 


A) 


(A < x < 1). 



The function f(x) is drawn in Fig. 4. 
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fa fa fa fa fa fa fa fa 1 



x 



FIG. 4: Kalman map constructed from the three-state stochastic process. The positions fy's are 
given in Eq. (A3). 

APPENDIX B: PROOFS OF THE STATEMENTS IN SEC. II 
1. Invariant probability density 

Let us consider the chaotic dynamics x n+ \ = f(x n ) with the piecewise linear mapping 
function (12). The probability density p n (x) obeys the evolution equation p n+ i(x) = 7ip n {x) 
with the Frobenius- Perron operator 7i. One can show that the invariant density p(x)(= 
7ip{x)) is expanded as 




(Bl) 



Here the function I ■ (x) is defined as 




(B2) 



(j = l,2, 



■ • • , iV 2 ). The coefficients c 1 ,c 2 ,--- ,c N2 are determined as follows. First, note the 



relation 




(B3) 
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where is the kj element of an ^-independent N 2 x N 2 matrix H_. The matrix H_ is 
obtained as follows. By putting ]_=(]- l)N + f , k = (k - 1)N + k' with 1 < j < N, 1 < 
k < N, 1 < f < N and 1 < k' < N and by noting Lj{y^/\f(y^\ = H^I^), Eq. (B3) 
is written as 



N 2 



H k=l 

Multiplying I_ k (x) to Eq. (B3) and integrating it over x, we obtain 

— hj_ = ^Jj^, j -(k-l)N+k'( X ) ^2 L(j-l)N+j'(yn( x ))dx 

ft 

where we gave used L( k -i)N+k'( x ) Y.^kj-i)N+j'hj^ x )) = Sj'kL( k -i)N+k'( x )- 
The explicit form of the iV 2 x iV 2 matrix H_ is given by 

H = 



With the expression (Bl) and the relation (B3), we get 

N 2 N 2 

j=i k=i 



(B4) 



(B5) 
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Equating Eqs. (Bl) and (B7), one obtains 

A' 2 



( -J 



fc=i 



By noting the relation (B5), Eq. (B8) is rewritten as 

JV 
k=l 

where we put ]_={]- l)N + f , k=(k- l)N + k',1 < j < N, 1 <k < N and 1 < / < 
iV, 1 < fc' < iV. Since the r.h.s. of Eq. (B9) is independent of j', we find that c^_^ N+ j, is 



free from j'. Therefore, by putting c (j _ 1)N+1 = c (j _ 1)N+2 = c (j _ 1)N+3 = ■■■ = c {j _ 1)N+N = c,, 
Eq. (B9) is written as 



N 



J2 H ikC k , (BIO) 



k=l 



and the probability density p(x) given in Eq. (Bl) is rewritten as 



N 



where we have defined 



1 for Pa-UN < x < 3 iN , 
l A .r) { P ° m (B12) 

otherwise. 

In order that Eq. (BIO) agrees with the result (4) in the stochastic process, we need Cj = 
otP^\ where a is independent of j. Furthermore, noting the normalization condition of the 
probability density p(x), we find Cj = NP* , (j = 1, 2, • • • , N). Equation (BIO) thus turns 
out to be identical with Eq. (4) in the stochastic process. 



2. Double-time correlation function 



The equivalence of the double time correlation functions derived from the Markov process 
(1) and that from the corresponding Kalman map was recently shown by Kohda and Fu- 
jisaki ll|]. The following discussion is the simplified one of their proof. The time correlation 
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function for a function u(x n ), where u(x) takes the value a^) if ^_-^ N < x < j3j N , is 
rewritten as 



C„= J 5u(x n )5u(x)p(x)dx. (B13) 

By defining the quantities a® 's by a® = a® for = (jfe- l)N+k', (1 < fc < N, 1 < fc' < N) 
and 5a® = a® — (u) and inserting the expression (Bl) and 8u(x) = ^2 k=1 ^~^Lki. x ) ' m ^° 
Eq. (B13), one gets 

C n=J p{x)5u{x)C n 5u{x)dx 

= /* U (*)WW»)*M1* 

= ^^CjSgPSa® / IjJix)7f l I j (x)dx, (B14) 
j=i fc=i " ^ 

where £ is the time evolution operator defined by CG{x) = G(f(x)). By noting 

TV 2 

= (B15) 

k=l 

the time correlation function is expanded as 

N 2 N 2 

C n=J2H A ^ (B16) 
i=i k=i 

where A k = J l k {x)dx. Putting j = (j - 1)AT+/ and = (fc-l^iV + A;' with 1 < j < N, 1 < 
fc < 1 < f < N and 1 < k' < N, we get A*. = (3 {k _ 1)N+k , - (3( k -i)N+k>-i = H Vk /N, and 
therefore ^2 k / =1 A(k-i)N+k' = Aw — P(k-i)N — N' 1 . These relations lead to 

(K )kj_ = {.H n ~ v ) kj iH rj , (B17) 

(n = 1,2,3, •• •). Furthermore, since 5 a® = 5a^ and Cj = NP^\ Eq. (B16) is reduced to 
the time correlation function (5) obtained in the stochastic process. 



3. Large deviation theoretical characteristic function 

The large deviation theoretical characteristic function for the time series {u(x m )}, where 
u(x) takes the value if P(j-i)N < x < PjN, (j — 1, 2, • • • , N). The characteristic function 
is rewritten as 



f(n) = J H n q p(x)dx, (B18) 
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where H. q is the generalized (order-g) Frobenius-Perron operator defined as 



HQ 



H q G(x) = H [e«**) G (x)] = lf/{ yJ - ■ (B19) 



Noting the relation 

A' 2 



n q L J (x) = J2h(x)(H q ) kl (B20) 

with the matrix H_ q whose kj element is defined by 

(i^_ = %exp[g#], (B21) 

(H q _ Q = H_), one obtains 

^4(x) = ^4(x)(^\_. (B22) 
k 

Therefore, since U n q p{x) = Ej Efc%4( x )CC)iy> we obtain z f( n ) = Ej Efe% A i(^)^ If 
we put i= (j - 1)N + f, k={k — 1)N + k' with 1 < j < N,l < f < N,l < k < N and 
1 < k' < N, then noting = c^, = H^^/N and 

(KgjkJ = (Hq)kj$kj>, (B23) 

(#Dm = (£r l M4)i'i. (B24) 

where (# 9 )fcj = H kj e qab \we obtain (n) = Ej J2k(Hq)kj%- By making use of c 3 - = iVPj^, 
the above expression coincides with Eq. (9). 

As proved above, those of the present chaotic dynamics constructed in the preceding 
section gives the results precisely same as those of the stochastic process. Therefore, the 
one-dimensional chaotic dynamics with the mapping function (12) precisely simulates the 
stochastic process (1). 

APPENDIX C: MARKOV METHOD FOR TIME CORRELATION FUNCTIONS 
OF ONE-DIMENSIONAL MAP 

We consider a chaotic one- dimensional map, 

x n+1 = f(x n ), (CI) 
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(n = 0, 1, 2, • • • ). The time series {u n } under consideration is given by u n = h{x n }, where 
h{x} is a unique scalar function of x. In terms of the time evolution operator £ defined 
by CG(x) = G(f(x)), u n obeys the equation of motion u n+ i = Cu n . The time correlation 
function C n = (u n uo), where (■ • • ) denotes the long time average, with u n being chosen such 
that (u n ) = 0, can be obtained by the Markov method proposed in Ref. [18] as follows. 
First, we introduce the vector variable 



u{x} = (hi{x}, h 2 {x}, ■■■ , h M +i{x}) T , (C2) 

where hi{x} is identical to h{x} under consideration. M is the number of new 
scalar variables, h2,hs,-- - ,Hm+i, and is assumed to be suitably chosen. The functions 
hi,h,2,--- , h-M+i are chosen so as to have vanishing means and have components linearly 
independent of each other. The vector variable u n defined by 



u, 



£ n u , u = u{x}, (C3) 



obeys the equation of motion u n+ \ = Cu n . 



With the projection operator method 35j, the above equation can be written in the form 



of the Mori equation of motion with a memory term. If M is appropriately chosen, the 



contribution from the memory term is expected to be small and can be ignored 
this approximation, the Mori equation reduces to 



3- 



With 



u n+1 w (u n + g n (C4) 

with 

(^([Cuolu^Mr 1 . (C5) 

The fluctuating force g n is orthogonal to u , i.e., (g n u^) = 6, {n > 0). By noting this 
property, the time correlation matrix C n = (u n u^) obeys C ri+ \ ~ (C n , which yields 

C n « CCq. (C6) 
By noting C, = CiCq 1 , the time correlation function C n is thus given by the 1-1 component of 



C n . The above approach to the time correlation function is called the Markov method 18l.l28| 
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APPENDIX D: DETERMINATION OF TIME-CORRELATION FUNCTIONS IN 
TERMS OF ONE UNSTABLE PERIODIC ORBIT 



In Sec. Ill, we determined time correlation functions of the Markov process in terms of 
many unstable periodic orbits embedded in the corresponding Kalman map. In particular 
we describe time correlation functions with static quantities ((% and Ci) and those static 
quantities with many unstable periodic orbits. However, for calculation of Co and C\ we 
do not have to determine the invariant density in terms of so many unstable periodic orbits 
because Co and C\ include only low order momentums. Here, as the simplest case, we 
determine dynamical correlations in terms of only single periodic orbit with a passing rate 
which is similar to invariant density. Thus we use the approximation to determine Cq and 
C\ in terms of an appropriate unstable periodic orbit instead of the long-time average as 

n— 1 

(G(x)) ^ —Y^G(xf), (Dl) 

p j=0 

where x^_ N = (j = 1,2, ■• • ,N P ) being a period- N p unstable periodic orbit appropri- 
ately chosen. If this approximation holds, then the dynamical correlation functions can be 



28]. 



approximately expanded in terms of an unstable periodic orbit 

Hereafter we will compare the time correlation functions with those by periodic orbit 
for N=2. The transition matrices H*s for N = 2 under study is the same as Sec. III. 
The results are shown in Fig. (J5j). Fig. ([5]) (a) shows the comparison between the time 
correlation functions obtained with the Markov method (M = 0) and the unstable periodic 
orbit shown in (b) with the exact one, Eq. (fl~5l) . One finds that even if only one unstable 
periodic orbit is used, one finds that the approximation is well done. 
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